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A.  INTRODUCTION 

In  this  research  project  we  have  studied  the  following 
topics  in  Control  and  Systems  Theory. 

1 .  Stochastic  realisation  theory 

2 .  Smoothing 

3.  Theory  for  matrix  Riccati  equations 

4.  The  partial  realization  problem 

5.  Stochastic  optimization  and  control. 

A  summary  of  the  results  is  given  in  Section  B,  a  list  of 
publications  in  Section  C,  and  abstracts  of  the  papers  in  Sec¬ 
tion  D. 

The  following  research  personnel  has  been  paid  by  project 
money. 

Principal  Investigator: 

Anders  Lindquist,  Professor 

Research  Assistants: 

Michele  Pa von,  graduate  student;  PhD  in  May  1979 

Faris  Badawi,  graduate  student;  PhD  in  May  1980 

Francisco  Solis,  graduate  student;  PhD  in  May  1981 

Consultants: 

Giorgio  Picci,  Professor  at  the  University  of  Padova, 

Italy 

Guy  Ruchebusch,  PhD,  Ecole  Polytechnique,  Palaiseau,  France. 

In  addition,  some  other  researchers  have  indirectly  con¬ 
tributed  to  the  project  through  co-authorship,  as  can  be  seen  from 
the  list  of  publications. 

A  list  of  oral  presentations  of  project  results  is  provided 
in  Section  E. 
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B.  SUMMARY  OF  RESEARCH  RESULTS 

1.  Stochastic  Realization  Theory 

Loosely  speaking,  the  stochastic  realization  problem  is  the 
inverse  problem  of  determining  a  stochastic  system  (or,  more  pre- 
cisely,  a  class  of  such  systems)  having  a  given  stochastic  process 
as  its  output  process.  This  is  the  fundamental  problem  in  stochastic 
systems  theory.  Our  study  of  this  problem  provides  a  framework  for 
other  investigations,  such  as  smoothing  (§2)  and  invariant  direc¬ 
tions  (§3).  Moreover,  it  provides  conceptual  insight  into  the  struc¬ 
ture  of  linear  (and  nonlinear)  stochastic  systems,  which  Will  be 
helpful  in  modeling  practical  systems. 

Reference  1  considers  the  stochastic  realization  problems  from 
a  concrete  (coordinate-dependent)  point  of  view.  The  basic  problem 
is  to  characterize  and  classify  all  linear  stochastic  systems  having 
a  given  vector  process  as  its  output;  such  a  model  is  called  a 
realization.  We  distinguish  between  internal  realizations  which  are 
completely  determined  by  the  given  output  process  and  external  rea¬ 
lizations  which  are  not.  It  is  shown  that  the  state  process  of  any 
internal  realization  can  be  expressed  in  terms  of  two  steady-state 
Kalman  filters,  one  evolving  forward  in  time  over  the  infinite  past 
of  the  given  process  and  one  backward  over  the  infinite  future. 
Connections  with  the  spectral  factorization  problem  are  investigated 
and  a  non-Riccati  algorithm  for  generating  families  of  stochastic 
realizations  (or  spectral  factors) ,  totally  ordered  with  respect  to 
their  state  covariances,  is  presented.  It  is  shown  that,  to  each 
realization,  there  corresponds  a  (strict  sense)  backward  realization. 
This  is  a  useful  result  in  many  applications,  notably  in  smoothing 
theory  ($2).  Ref.  1  deals  with  continuous-time  processes.  The 
corresponding  discrete- time  results  can  be  found  in  Ref.  6. 

Both  these  papers  deal  with  realization  of  stationary  processes. 
Sense  results  for  the  corresponding  nonetationary  problem  are  pre¬ 
sented  in  References  9  and  11  (Chapter  III),  the  latter  of  which 
contains,  as  a  by-product,  a  natural  stochastic  interpretation  of 
an  algorithm  due  to  Cleget  for  the  minimum  and  maximum  variance 
realizations. 

In  References  2,  3,  4  and  5  we  develop  a  geometric  state  space 
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theory  for  stochastic  processes  based  on  the  concept  of  splitting 
sub  space .  Among  other  things  this  theory  clarifies  the  roles  of 
observability  and  controllability  in  stochastic  systems  theory  and 
provides  stochastic  interpretations  for  and  insight  into  filtering 
algorithms.  In  Ref.  2,  given  a  stationary  Gaussian  stochastic  process 
y  with  rational  spectral  density/  we  determine  all  Markovian  fami¬ 
lies  of  minimal  splitting  subspaces  of  K(y)/  where  H(y)  is  the  Hilbert 
space  spanned  by  the  process  y;  the  splitting  subspaces  act  as  state 
spaces.  Each  such  family  gives  rise  to  an  equivalence  class  of  linear 
state  space  models  with  white  noise  inputs  and  y  as  the  output, 
systems  of  the  type  used  in  modeling  engineereing  problems.  In  fact, 
we  obtain  all  such  models  which  can  be  constructed  in  terms  of  the 
given  process  (internal  realizations).  In  Ref.  3  we  develop  a  more 
general  theoretical  framework  which  will  allow  us  to  obtain  a  simi¬ 
lar  theory  for  non-stationary  processes  and  to  obtain  also  the  models 
which  cannot  be  constructed  in  terms  of  y  (external  realizations) . 

In  Ref.  4  the  powerful  theory  of  Hardy  spaces  is  applied  to  the 
problem,  yielding  abstract  solutions  also  for  infinite-dimensional 
systems;  this  will  enable  us  to  apply  the  theory  to  time-delay 
systems  and  distributed  parameter  systems.  Finally,  in  ref.  5,  this 
Hardy  space  theory  is  generalized  to  the  multivariate  case.  A  new 
approach  to  the  basic  geometric  problem  is  presented,  more  suitable 
for  the  multivariate  setting.  It  is  shown  that  each  state  space  is 
the  isomorphic  image  of  the  closure  of  a  certain  Hankel  operator, 
which  facilitates  the  application  of  the  infinite-dimensional  de¬ 
terministic  realization  theory  of  Brockett,  Baras  and  Fuhrmann  to 
stochastic  systems.  However,  this  has  to  be  done  with  some  care, 
as  we  shall  se  below  (Reference  24). 

In  Reference  8  we  introduce  a  new  mathematical  framework  for 
the  basic  geometric  problem  described  above  which  we  preceive  as 
more  natural  and  conceptually  sounder  than  our  previous  one.  The 
basic  concept  is  that  of  p srpsndiaulavly  intn'scoting  subspaass. 

By  relating  minimality  of  stochastic  realizations  to  the  factori¬ 
zation  of  certain  Hankel  operators,  the  connections  to  determi¬ 
nistic  realization  theory  is  further  clarified.  Furthermore, 
spectral  domain  criteria  for  minimality,  observability  and  con¬ 
struct  ibility  are  presented.  The  last  part  of  the  paper  is  devoted 
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to  a  procedure  to  obtain  differential  equation  representations 
for  all  state  spaces  which  are  finite  dimensional. 

Reference  13  contains  a  comprehensive  presentation  of  the 
geometric  theory.  These  results  are  then  carried  over  to  the 
spectral  domain  and  described  in  terms  of  Hardy  functions.  Each 
state  space  is  uniquely  characterized  by  its  structural  function, 
an  inner  (or,  in  engineering  language,  all-pass)  function  which 
contains  all  the  systems  theoretical  characteristics  of  the 
corresponding  realizations.  (This  part  of  the  theory  has  strong 
connection  to  Lax-Phillips  scattering  theory.)  Observability  and 
constructibility  is  described  in  terms  of  coprimeness  of  certain 
inner  functions  characterizing  the  splitting  subspace,  one  of 
which  is  the  structural  function.  From  this,  differential-equa- 
tion-type  representations  are  derived.  However,  this  part  of  the 
paper  contains  an  error,  and  the  reader  is  referred  to  Ref.  24 
for  the  correct  version.  (These  difficulties  are  caused  by  the 
continuous -time  assumption.  They  do  not  occur  in  discrete  time.) 

To  each  splitting  subspace  there  correspond  two  realizations,  one 
evolving  forward  and  one  backward  in  time.  It  is  shown  that  the 
forward  realization  is  observable  in  the  usual  sense  of  determi¬ 
nistic  systems  theory  if  and  only  if  the  splitting  subspace  is  ob¬ 
servable  in  the  geometric  sense  described  in  the  beginning  of  the 
paper,  in  the  same  way,  constructibility  of  the  splitting  subspace 
corresponds  to  observability  (or,  more  precisely,  constructibility) 
of  the  backward  representation.  (Both  realizations  are  always 
reachable.)  Finally,  coordinates  are  introduced  and  concrete  dyna¬ 
mical  representations  are  derived.  The  coordinatization  provides 
further  insights  into  the  connections  between  forward  and  backward 
Markovian  representations,  which  have  been  the  topic  of  several 
studies  in  the  smoothing  literature. 

In  Ref.  16  we  settle  a  mathematical  question  which  was  long 
somewhat  of  a  bottleneck  in  this  area  of  research.  Given  a  statio¬ 
nary  Gaussian  vector  process  y,  consider  a  Markovian  splitting  sub¬ 
space  X  contained  in  the  frame  space  which  is  either  observable  or 
constructive.  Such  an  X  is  called  reduced.  Our  main  result  is 
that  a  Markovian  splitting  subspace  is  minimal  if  and  only  if  it 
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is  reduced.  If  y  is  a  scalar  process,  this  is  not  hard  to  prove, 
because  then  all  reduced  Markovian  splitting  subspaces  have  the 
same  structural  function  (an  inner  function  which  contains  all  the 
systems-theoretical  information  about  the  splitting  subspace).  In 
the  vector  case  the  key  is  our  main  lemma,  which  states  that  all 
reduced  X  have  quasi-equivalent  structural  functions.  This  also 
leads  to  a  Jordan  model  for  the  minimal  X. 

In  Kef.  18  we  give  a  comprehensive  survey  of  our  stochastic 
realization  theory  for  discrete-time  processes  and  provide  some 
new  ideas.  In  order  to  make  the  basic  ideas  the  main  thing  and 
not  unnecessarily  obscure  the  mathematics,  we  have  chosen* the 
simplest  possible  formulation  which  still  contains  the  main  fea¬ 
tures  of  the  problem.  (Hence  we  consider  a  multivariate  output 
process  rather  than  a  scalar  one.)  The  construction  of  stochastic 
realizations  consists  of  three  steps:  (i)  determining  all  state 
spaces,  (ii)  analysis  and  characterization  of  the  state  spaces  in 
terms  of  Hardy  functions,  and  (iii)  construction  of  dynamical  sys¬ 
tems  (models) .  Step  (i)  is  a  geometric  theory  in  the  Hilbert  space 
of  random  variables  generated  by  the  (given)  output  process;  step 
(ii)  is  similar  to  the  construction  in  Lax-Phillips  scattering 
theory  (although  we  do  not  yet  fully  understand  the  physical  signi¬ 
ficance  of  this  analogy);  in  step  (iii),  finally,  we  apply  some  of 
the  ideas  of  Ref.  16  and  analyze  the  models  from  a  systems-theore¬ 
tical  point  of  view.  Some  new  ideas  concerning  the  question  of  de¬ 
generacy  discussed  in  Ref.  21  are  also  presented. 

Ref.  22  is  a  comprehensive  treatment  of  the  discrete-time 
problem.  There  are  some  decidedly  nontrivial  problems  which  are 
unique  to  the  discrete-time  setting  (whereas,  on  the  other  hand, 
some  subtle  difficulties  of  the  continuous-time  formulation  are 
no  longer  present).  These  include  such  considerations  as  the  defini¬ 
tion  of  past  and  future,  different  choices  creating  different 
classes  of  models,  and  in  particular,  certain  degeneracies  which 
do  not  occur  in  the  continuous-time  case  and  which  are  also  ob¬ 
served  in  deterministic  systems.  One  type  of  degeneracy  is  related 
to  singularity  of  the  transition  function,  another  to  the  concept 
of  invariant  (or  constant)  directions.  Criteria  for  degeneracy  are 
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first  described  geometrically  in  the  basic  Hilbert  space  of  random 
variables.  These  results  are  then  carried  over  to  the  spectral  do¬ 
main  and  described  in  terms  of  the  same  inner  functions  which  occur 
in  the  above  mentioned  criteria  for  observability  and  constructi- 
bility.  Then  it  is  shown  how  degeneracy  can  be  detected  directly 
from  the  spectral  density.  Finally  we  consider  the  connections 
between  the  classes  of  models  corresponding  to  two  different  choices 
of  past  and  future.  One  leads  to  models  without  observation  noise 
and  one  to  models  with  such  a  noise  term.  It  is  shown  that  the  con¬ 
nection  between  these  classes  depends  on  the  occurance  of  degeneracy 

In  the  geometric  theory  of  stochastic  realization  described 
above  the  output  process  is  assumed  to  be  Gaussian.  Therefore  all 
stochastic  models  are  linear.  This  linear  theory  can  be  applied  to 
non-Gaussian  processes  also,  but  then  we  need  to  give  up  the  re¬ 
quirement  that  the  state  process  is  Markovian  and  (in  continuous 
time)  that  the  system  is  generated  by  Wiener  process,  replacing 
these  concepts  by  "wide  sense  Markov"  (in  the  sense  of  Doob)  and 
"orthogonal  increment  process"  respectively.  If  we  are  not  willing 
to  do  so,  a  nonlinear  stochastic  realization  theory  is  needed.  This 
is  the  topic  of  Ref.  17. 

In  this  paper  we  apply  Wiener 1 s  theory  of  homogeneous  chaos 
to  the  nonlinear  stochastic  realization  problem.  This  enables  us 
to  carry  over  the  basic  results  of  the  linear  theory,  appropriate¬ 
ly  modified,  to  the  nonlinear  setting.  The  state  spaces  are  taken 
to  be  direct  sums  of  subspaces,  one  in  each  chaos.  The  component 
X  of  the  first  chaos  is  a  Markovian  splitting  subspace  determined 
as  in  the  linear  component;  the  component  XR  of  the  n:th  chaos  is 
isomorphic  to  an  n-fold  tensor  product  of  X.  Therefore  the  ele¬ 
ments  of  Xn  can  be  represented  by  multiple  Wiener  integrals  of 
order  n. 

The  purpose  of  the  paper  is  to  investigate  the  structural 
aspects  of  the  nonlinear  stochastic  realization  problem  and  to 
clarify  basic  concepts.  This  is  a  first  step  toward  a  nonlinear 
realisation  theory.  Hence  we  have  not  concerned  ourselves  with 
algorithmic  aspects  of  the  problem,  and  our  analysis  is  based 
on  the  availability  of  an  innovation  representation,  the  actual 
determination  of  which  is  a  nontrivial  problem  in  itself.  Our 
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interest  in  the  nonlinear  realization  problem  emanates  from  its 
potential  value  as  a  conceptual  framework  for  certain  classes  of 
nonlinear  filtering  problems. 

Ref.  25,  finally,  deals  with  realization  of  continuous-time 
processes  with  .stationary  increments.  This  leads  to  a  theory  of 
forward  and  backward  semimartingales.  See  Section  D  for  further 
details. 

2 .  Smoothing 

In  References  7  and  9  we  develop  a  theory  of  smoothing  for 
finite  dimensional  linear  stochastic  systems  in  the  context  of 
stochastic  realization  theory.  The  basic  idea  is  to  embed  the 
given  stochastic  system  in  a  class  of  similar  systems  all  having 
the  same  output  process  and  the  same  Kalman-Bucy  filter.  This 
class  has  a  lattice  structure  with  a  smallest  and  a  largest  ele¬ 
ment;  these  two  elements  completely  determine  the  smoothing  esti¬ 
mates.  This  approach  enables  us  to  obtain  stochastic  interpreta¬ 
tions  of  many  important  smoothing  formulas  and  to  explain  the  re¬ 
lationship  between  them.  One  of  our  main  objectives  was  to  provide 
a  stochastic  interpretation  of  Mayne-Fraser  two-filter  formula,  a 
problem  which  previously  has  been  approached  (unsuccessfully)  by 
many  workers  in  the  field.  We  show  that  the  so-called  "backward 
filter"  is  actually  a  forward  filter,  namely  the  maximum-variance 
realization.  In  my  opinion,  one  will  never  obtain  a  clear  picture 
of  the  merits  of  the  various  smoothing  algorithms  without  investi¬ 
gating  (as  we  have  now  done)  their  stochastic  meanings. 

,  In  Chapter  II  of  Ref.  11a  smoothing  theory  for  discrete-time 
nonstationary  systems  is  developed.  Just  as  in  continuous  time,  it 
is  shown  that  the  smoothing  estimate  is  contained  in  a  finite-di¬ 
mensional  space  F^,  the  frame  space.  However,  unlike  the  situation 
in  continuous  time,  in  the  discrete  setting,  is  not  of  constant 
dimension,  contributing  to  the  fact  that  this  problem  is  not  merely 
a  trivial  modification  of  its  continuous-time  counterpart.  In  the 
continuous- time  setting,  the  invert ibility  of  certain  covariance 
matrices  is  essential.  In  discrete  time,  this  invertibility  does 
not  hold  on  the  whole  interval.  Hence  the  generalised  Moore- Pen¬ 
rose  pseudoinverse  is  applied,  thereby  introducing  some  further 
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structure  in  the  theory.  A  two-filter  formula, of  the  Mayne-Fraser 
type  is  derived  for  the  smoothing  estimate.  In  the  final  section 
of  Chapter  II  we  use.  a  different  technique  to  derive  the  smooth¬ 
ing  formulas  of  Bryson  and  Frazier  and  Rauch,  Tung  and  Striebel, 
which  does  not  employ  the  frame  space. 

The  purpose  of  Ref.  14  (by  Pavon)  is  to  illustrate  the  role 
played  by  the  conjugate  process  in  continuous  time  stochastic  rea¬ 
lization  theory.  In  particular,  it  is  shown  that  the  input  of 
every  internal  realization  can  be  generated  by  an  anticausal 
whitening  filter  driven  by  the  conjugate  process.  In  this  framework 
some  new  smoothing  formulas  phrased  in  terms  of  the  conjugate  pro¬ 
cess  are  derived.  The  optimal  bilateral  predictor  is  shown  to  be 
the  natural  discrete-time  counterpart  of  the  smoothing  estimate  of 
the  observation  signal,  a  fact  overlooked  in  previous  smoothing 
literature.  Several  explicit  expressions  for  the  bilateral  predic¬ 
tion  are  given  which  represent  a  considerable  improvement  on  the 
results  of  Salehi  based  on  von  Neumann's  alternating  projection 
theorem.  In  discrete  time,  stationary  processes  are  considered, 
in  continuous  time,  processes  with  stationary  increments  are 
studied. 


Theory  for  matrix  Riccati  equations 


In  Ref.  12  the  factorizations  of  the  matrix  Riccati  equation 
underlying  the  fast  (non- Riccati)  algorithms  are  derived  in  the 
context  of  Hamiltonian  systems  and  the  variational  problem 
corresponding  to  the  matrix  Riccati  equation.  The  primary  purpose 
of  the  paper  is  to  place  these  factorization  results  in  a  natural 
theoretical  framework,  useful  for  further  analysis.  Previous  deri¬ 
vations  of  these  results,  in  their  most  general  formulations,  are 
based  on  ad  hoc  matrix  manipulations  which  give  very  little  insight 
into  what  is  really  going  on.  Although  we  are  primarily  interested 
in  discrete-time  Riccati  equations,  for  comparison,  the  correspond¬ 
ing  continuous-time  result  is  also  briefly  discussed.  This  is  also 
one  of  the  topics  of  Chapter  I  in  Ref.  11. 

In  the  same  chapter,  (wide  sense)  stochastic  realization  theory 
for  stationary  processes  with  rational  spectral  densities  is  studied 
both  in  discrete  and  continuous  time.  The  set  P  of  all  solutions 


of  the  Quadratic  Matrix  Inequality  is  considered,  as  is  the  subset 
PQ  of  P  consisting  of  the  solutions  of  the  corresponding  Algebraic 
Riccati  Equation.  A  parametric  representation  for  P  is  given  and  its  bound¬ 
ary  points  are  characterised.  Then  it  is  shown  that  the  elements  of  P 

o 

are  extreme  points  of  P.  (Although  this  seems  to  be  a  well-known  re¬ 
sult,  we  were  unable  to  find  a  proof  of  this  anywhere  in  the  literature. 
However,  since  then,  we  have  discovered  a  similar  proof  »  a  re¬ 
cently  published  book  by  Faurre,  Clerget  and  Germain.)  i  ’ever, 
the  converse  of  this  statement,  namely  that  all  extreme  ints  of 
P  belong  to  PQ,  is  false.  This  we  show  in  Ref.  23. 

In  Ref.  6  Pavon  studies  invariant  directions  for  the  .^trix 
Riccati  equations  of  Kalman  filtering  and  describes  the  connec¬ 
tions  to  stochastic  realization  theory  and  filtering.  The  stochas¬ 
tic  realization  setting  turns  out  to  be  the  right  framework  for 
properly  understanding  the  phenomenon  of  invariant  directions, 
yielding  a  rather  elegant  geometric  theory.  In  fact,  the  invariant 
directions  are  invariant  over  the  whole  class  of  stochastic  reali¬ 
zations. 


4.  The  partial  realization  problem 

In  References  19  and  20  we  consider  the  partial  realisation 
problem,  which  is  of  central  importance  in  (deterministic)  systems 
theory.  A  scalar  version  of  this  problem  can  be  described  in  the 
following  way.  Given  a  finite  sequence  y:  * (y1 , y2, . . . / YN)  of  real 
numbers,  find  a  triplet  £  ■  (A,B,C)  of  matrices  in  Rnxn,Iinx1  and 
respectively  so  that 

CA1”1®  -  ya  for  i  -  1,2,...,N  (1) 

and  so  that  n  is  as  small  as  possible.  Such  a  triplet  is  called  a 
realisation  of  y. 

The  importance  of  the  partial  realization  problem  in  systems 
theory  emanates  froai  the  fact  that  £  corresponds  to  a  linear 

epetem 

|x(t+1)  ■  Ax(t)  ♦  Bu(t) 
ylt)  ■  Cx(t) 

(t  *0,1,2,...),  where  x(t)  €»n  is  called  the  state,  y(t)  €*  the 
output,  and  a(t)  (2  the  input  at  time  t.  Then  the  sequence  r  is 
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a  section  of  the  impulse  response  of  the  system  (2)  in  the  sense 
that,  if  we  choose  u{0)  =1,  u(1)  =  u(2)  =  ...  =  u  (N)  =0,  and  x(0)  =0, 
we  obtain  the  output  y(t)  = yfc  for  t  »1,2,...,N.  In  other  words, 
the  partial  realization  problem  is  the  inverse  problem  of  deter¬ 
mining  a  system  (2)  from  its  partial  impulse  response  y.  A  complete 
impulse  response  {y^ ,Y2»Y3# « • . )  is  usually  not  available  from  data, 
and  therefore  we  must  content  ourselves  with  a  partial  realization. 
The  same  partial  realization  problem  is  obtained  if  (2)  is  replaced 
by  the  continuous-time  system 


x  =  Ax  +  Bu 
y  *  Cx 


(3) 


In  Ref.  19  we  take  a  unified  approach  to  the  partial  realiza¬ 
tion  problem  in  which  we  seek  to  incorporate  ideas  from  numerical 
linear  algebra,  most  of  which  were  originally  developed  in  other 
contexts.  We  approach  the  partial  realization  problem  from  several 
different  angles  and  explore  the  connections  to  such  topics  as 
factorization  of  Hankel  matrices,  block  tridiagonalization,  genera¬ 
lizations  of  the  Lanczos  process  for  biorthogonalization,  the 
Euclidean  algorithm  and  the  principal  part  continued  fractions  of 
Arne  Magnus,  the  Padfi  table,  and  the  Berlekamp-Massey  algorithm. 

In  this  way  we  are  able  to  clarify  some  previous  results  by  Rissanen, 
Kalman  and  others  and  place  them  in  a  broader  context.  This  leads 
to  several  results  and  concepts  which  we  think  are  new.  Our  analysis 
is  restricted  to  the  scalar  case,  but  sexae  definitions  and  formula¬ 
tions  have  been  rigged  to  facilitate  an  extension  to  the  matrix 
case.  Finally,  we  discuss  briefly  partial  realization  of  covariance 
sequences . 

A  finite  or  infinite  sequence  y  (of  real  numbers)  is  said  to 
be  stable  if  it  admits  minimal  realization  by  a  stable  linear  system. 
(System  (2)  is  said  to  be  stable  if  all  eigenvalues  of  A  are  in  the 
open  unit  disc,  and  (3)  is  stable  if  they  are  in  the  open  half  plane.) 
In  Ref.  20  it  is  shown  that  the  preservation  of  stability  as  such 
a  sequence  is  truncated  or  extended  is  not  a  generic  property  even 
among  stable  sequences.  This  is  of  interest  for  identification  of 
linear  systems  from  partial  data  and  for  partial  realization  of 
random  systems,  in  which  cases  it  constitutes  a  negative  result 
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and  answers  in  the  negative  a  question  raised  by  Kalman.  Certain 
finite  sequences  have  infinitely  many  minimal  realizations  each 
having  different  stability  properties.  In  this  case,  a  graphical 
criterion  in  the  spirit  of  the  Nyquist  criterion  is  derived  to 
exploit  this  lack  of  uniqueness  in  order  to  determine  whether  one 
can  achieve  a  stable  pole  placement  by  a  judicious  choice  of  par¬ 
tial  realization. 

5.  Stochastic  estimation  and  control 

In  Reference  15  F.  Solis  considers  stochastic  optimization 
problems  formulated  as  the  minimization  of  expectation  functio¬ 
nals.  This  research  consists  of  two  parts.  In  the  first,  suffi¬ 
cient  conditions  for  these  functionals  to  be  lower  semi-continu¬ 
ous,  differentiable  and  inf-compact  are  presented.  The  subdiffe¬ 
rentiability  properties  of  the  functionals  are  investigated,  and 
these  results  are  used  in  obtaining  the  sufficient  conditions  for 
differentiability  and  to  settle  certain  questions  of  Lipschitz 
domination.  These  problems  are  usually  solved  assuming  knowledge 
of  the  underlying  probability  measure.  In  most  cases,  this  measure 
is  an  approximation  based  on  a  sample,  and  the  larger  the  sample 
the  better  the  approximation.  In  the  second  part,  sufficient  con¬ 
ditions  are  obtained  for  the  convergence  of  the  solutions  based 
on  these  approximations  to  the  solution  of  the  actual  problem,  and 
conditions  under  which  we  can  estimate  the  rate  of  convergence  are 
identified.  Finally,  an  algorithm  is  proposed  which  estimates  the 
rate  of  convergence  and  some  problems  if  implementation  are  dis¬ 
cussed. 

Reference  10  is  merely  a  short  note  to  point  out  an  error  which 
is  very  common  in  the  literature.  This  error,  which  can  be  found 
in  many  of  the  early  papers  and  books  on  the  subject  and  therefore 
is  constantly  carried  on  to  more  recent  works,  is  caused  by  a 
misunderstanding  of  the  effects  of  feedback  in  stochastic  systems. 
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D.  ABSTRACTS  OF  PUBLICATIONS 


1.  On  the  stochastic  realization  problem 

Given  a  mean- square  continuous  stochastic  vector  process  y  with 
stationary  increments  and  a  rational  density  *  such  that  ♦ («)  is 
finite  and  nonsingular,  consider  the  problem  of  finding  all  minimal 
Gauss-Markov  representations  (stochastic  realizations)  of  y.  All 
such  realizations  are  characterized  and  classified  with  respect  to 
deterministic  as  well  as  probabilistic  properties.  It  is  shown 
that  only  certain  realizations  (internal  stochastic  realizations) 
can  be  determined  from  the  given  output  process  y.  All  others  (ex¬ 
ternal  stochastic  realizations)  require  that  the  probability  space 
be  extended  with  an  exogeneous  random  component.  A  complete  charac¬ 
terization  of  the  sets  of  internal  and  external  stochastic  realiza¬ 
tions  is  provided.  It  is  shown  that  the  state  process  of  any  inter¬ 
nal  stochastic  realization  can  be  expressed  in  terms  of  two  steady- 
state  Kalman-Bucy  filters,  one  evolving  forward  in  time  over  the 
infinite  past  and  one  backward  over  the  infinite  future.  An  algorithm 
is  presented  which  generates  families  of  external  realizations  de¬ 
fined  on  the  same  probability  space  and  totally  ordered  with  respect 
to  state  covariances. 

2.  A  state  space  theory  for  stationary  stochastic  processes 

Consider  a  stationary  Gaussian  stochastic  process  {y(t);t€R> 

with  a  rational  spectral  density,  and  let  H(y)  be  the  Hilbert  space 
spanned  by  it.  The  problem  of  determining  all  stationary  and  purely 
nondeterministic  families  of  minimal  splitting  subspaces  of  H(y)  is 
considered;  the  splitting  subspaces  constitute  state  spaces  for  the 
process  y.  It  is  shown  that  some  of  these  families  are  Markovian, 
and  they  lead  to  internal  stochastic  realizations.  A  complete  charac¬ 
terization  of  all  Markovian  and  non-Markovian  families  of  minimal 
splitting  subspaces  is  provided.  Many  of  the  basic  results  hold 
without  the  assumption  of  rational  spectral  density. 

3.  On  minimal  splitting  subspaces  and  Markovian  representations 

Given  a  Hilbert  space  H,  let  and  H2  be  two  artibrary  subspaces. 


The  problem  of  finding  all  minimal  splitting  subspaces  of  H  with 
respect  to  and  H2  is  solved.  This  result  is  applied  to  the  sto¬ 
chastic  realization  problem.  Each  minimal  stochastic  realization 
of  a  given  vector  process  y  defines  a  family  of  state  spaces.  It 
is  shown  that  these  families  are  precisely  those  families  of  mini¬ 
mal  splitting  subspaces  (with  respect  to  the  past  and  the  future 
of  y)  which  satisfy  a  certain  growth  condition. 

4.  A  Hardy  space  approach  to  the  stochastic  realization  problem 

Given  a  purely  nondeterministic  mean-square  continuous  Gaussian 
stationary  stochastic  process  we  consider  the  problem  of  characte¬ 
rizing  all  minimal  splitting  subspaces  X  which  evolve  in  time  in  a 
Markovian  fashion.  Let  H+^_  and  H”^+  be  the  projections  of  the 
future  of  the  given  process  onto  the  past  and  the  past  onto  the 
future  respectively.  It  is  shown  that  the  family  (x)  of  minimal 
Markovian  splitting  subspaces  can  be  isomorphically  described  as 
a  partially  ordered  family  of  subspaces  of  the  form  X  *  jX*  where 
3E*  *  H“/+  and  j  ranges  over  the  family  of  all  inner  divisors  of  a 
fixed  inner  function  j*  uniquely  defined  by  H+^“.  The  procedure  is 
illustrated  with  an  application  to  a  process  with 'a  rational 
spectral  density. 

5^ _ Realization  theory  for  multivariate  stationary  Gaussian  pro¬ 

cesses  It  State  space  construction 

A  new  approach  to  the  problem  of  determining  all  internal  mini¬ 
mal  Markovian  splitting  subspaces  of  a  given  stationary  process  y 
is  presented  which  is  particularly  suitable  for  solving  the  multi¬ 
variate  stochastic  realization  problem.  Under  the  assumption  that  y 
is  strictly  noncyclic  it  is  shown  that  each  such  state  space  can  be 
expressed  in  terms  of  two  subspaces  spanned  by  the  pasts  of  a 
corresponding  pair  of  Wiener  processes,  one  being  a  forward  and  the 
other  a  backward  innovation  process  for  the  state  space.  This  makes 
it  possible  to  solve  the  problem  in  the  Hardy  space  H2#  and  each 
state  space  is  seen  to  be  the  isomorphic  image  of  the  closure  of  a 
certain  Hankal  operator  in  H2.  This  result  will  facilitate  the 
application  of  existing  infinite-dimensional  deterministic  realisa- 
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tion  theory  to  obtain  explicit  Markovian  representations;  this  is 
the  topic  of  Part  II. 

6.  Stochastic  realization  and  invariant  directions  of  the  matrix 
Rlccati  equation 

Invariant  directions  of  the  Riccati  difference  equation  of 
Kalman  filtering  are  shown  to  occur  in  a  large  class  of  prediction 
problems  and  to  be  related  to  a  certain  invariant  subspace  of  the 
transpose  of  the  feedback  matrix.  The  discrete  time  stochastic  rea¬ 
lization  problem  is  studied  in  its  deterministic  as  well  as  proba¬ 
bilistic  aspects.  In  particular  a  new  derivation  of  the  classifi¬ 
cation  of  the  minimal  Markovian  representations  of  the  given  pro¬ 
cess  z  is  presented  which  is  based  on  a  certain  backward  filter 
of  the  innovations.  For  each  Markovian  representation  which  can 
be  determined  from  z  the  space  of  invariant  directions  is  decom¬ 
posed  into  two  subspaces,  one  on  which  it  is  possible  to  predict 
the  state  process  without  error  forward  in  time  and  one  on  which 
this  can  be  done  backward  in  time. 

7.  A  stochastic  realization  approach  to  the  smoothing  problem 
The  purpose  of  this  paper  is  to  develop  a  theory  of  smoothing 

for  finite  dimensional  linear  stochastic  systems  in  the  context  of 
stochastic  realization  theory.  The  basic  idea  is  to  embed  the  given 
stochastic  system  in  a  class  of  similar  systems  all  having  the  same 
output  process  and  the  same  Kalman-Bucy  filter.  This  class  has  a 
lattice  structure  with  a  smallest  and  a  largest  element;  these  two 
elements  completely  determine  the  smoothing  estimates.  This  approach 
enables  us  to  obtain  stochastic  interpretations  of  many  important 
smoothing  formulas  and  to  explain  the  relationship  between  them. 

8.  Realization  theory  for  multivariate  Gaussian  processes  lit 
State  space  theory  revisited  and  dynamical  representations  of 
finite  dimensional  state  spaces 

The  purpose  of  this  paper  is  twofold.  First,  some  of  the  results 
of  Part  I  are  generalised  and  clarified,  reformulated  in  a  mathe¬ 
matical  framework  which  we  now  perceive  as  more  natural  and  con- 
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ceptually  sounder,  the  basic  concept  being  perpendicularly  inter¬ 
secting  subspaces.  By  relating  minimality  of  stochastic  realiza¬ 
tions  to  the  factorization  of  certain  Hankel  operators,  the  connec¬ 
tions  to  deterministic  realization  theory  is  further  clarified. 
Furthermore,  spectral  domain  criteria  for  minimality,  observability 
and  constructibility  are  presented.  Secondly,  stochastic  differenti¬ 
al  equation  representations  are  presented  for  all  state  spaces  which 
are  finite  dimensional.  The  infinite  dimensional  case  will  be  the 
topic  of  Part  III  of  this  sequence  of  papers. 

• 

9.  On  the  Mayne-Fraser  smoothing  formula  and  stochastic  realization 
theory  for  nonstationary  linear  stochastic  systems 
This  paper  is  a  shortened  version  of  Ref.  7,  its  basic  purpose 
being  to  provide  an  easily  accessible  introduction  to  the  results 
of  Ref.  7,  many  of  which  are  presented  here  without  proofs.  However, 
we  have  tried  to  rearrange  the  material  of  Ref.  7,  changing  the  lo¬ 
gical  order  in  which  various  topics  are  introduced,  and  occasional¬ 
ly  we  regard  the  results  from  a  somewhat  different  angle.  This  has 
been  done  to  increase  the  present  paper’s  usefulness  as  a  comple¬ 
ment  to  Ref.  7. 

The  work  reported  here  is  aimed  at  providing  a  theory  of  smooth¬ 
ing  in  the  context  of  stochastic  realization  theory.  This  approach 
enables  us  to  obtain  stochastic  interpretations  of  many  important 
smoothing  formulas  and  to  explain  the  relationship  between  them. 

In  this  paper,  however,  we  shall  only  consider  one  such  formula, 
namely  the  Mayne-Fraser  two-filter  formula,  which  has  a  very  natural 
interpretation  in  the  stochastic  realization  setting;  we  refer  the 
reader  to  Ref.  7  for  further  results.  As  a  by-product,  we  also  ob¬ 
tain  certain  results  on  the  stochastic  realization  problem  itself 
which  cannot  be  found  in  Ref.  7. 

12.  A  Hamilton  approach  to  the  factorization  of  the  matrix 
Riccatl  equation 

In  this  note  the  theory  of  Hamiltonian  systems  and  an  idea  due 
to  L.E.Zachrlsson  is  used  to  obtain  the  factorizations  of  the  matrix 
Rlccati  difference  equation  on  which  the  usual  derivations  of  fast 
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(non-Riccati)  algorithms  are  based.  Although  we  are  primarily 
interested  in  discrete-time  Riccati  equations,  for  comparison, 
the  corresponding  continuous-time  result  is  briefly  discussed. 

13.  State  space  models  for  Gaussian  stochastic  processes 

A  comprehensive  theory  of  stochastic  realization  for  multi¬ 
variate  stationary  Gaussian  processes  is  presented.  It  is  coordi¬ 
nate-free  in  nature,  starting  out  with  an  abstract  state  space 
theory  in  Hilbert  space,  based  on  the  concept  of  splitting  sub¬ 
space.  These  results  are  then  carried  over  to  the  spectral  do¬ 
main  and  described  in  terms  of  Hardy  functions.  Each  state  space 
is  uniquely  characterized  by  its  structural  function,  an  inner 
function  which  contains  all  the  systems  theoretical  characteris¬ 
tics  of  the  corresponding  realizations.  Finally  coordinates  are 
introduced  and  concrete  differential-equation-type  representa¬ 
tions  are  obtained.  This  paper  is  an  abridged  version  of  a  forth¬ 
coming  paper,  which in  turn  summarizes  and  considerably  extends 
results  which  have  previously  been  presented  in  a  series  of  preli¬ 
minary  conference  papers. 

16.  On  a  condition  for  minimality  of  Markovian  splitting  subspaces 
Given  a  stationary  Gaussian  vector  process,  consider  a  Markovi¬ 
an  splitting  subspace  X  contained  in  the  frame  space  which  is 
either  observable  or  constructible.  Such  an  X  will  be  called  re¬ 
duced.  In  this  paper  we  show  that  a  Markovian  splitting  subspace 
is  minimal  if  and  only  if  it  is  reduced.  This  was  claimed  in  some 
earlier  papers  but  there  are  nontrivial  gaps  in  the  proofs  present¬ 
ed  there.  The  proof  is  based  on  a  lemma  stating  that  all  reduced  X 
have  quasi-equivalent  structural  functions.  This  property  is  also 
important  in  isomorphism  theory  for  minimal  splitting  subspaces. 

18.  Recent  trends  in  stochastic  realization  theory 

This  is  a  survey  of  some  recent  work  on  Markovian  representa¬ 
tion  of  multivariate  stationary  stochastic  processes.  First  a  geo¬ 
metric  theory  in  Hilbert  space  is  developed.  Next  these  results 
are  translated  into  a  Hardy  space  setting,  and  a  complete  set  of 
.Markov  models  are  constructed  for  the  given  process.  These  models 
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are  then  analyzed  from  a  systems  theoretical  point  of  view. 

19.  On  the  partial  realization  problem 

In  this  paper  we  take  a  unified  approach  to  the  partial  rea¬ 
lization  problem  in  which  we  seek  to  incorporate  ideas  from  nume¬ 
rical  linear  algebra,  most  of  which  were  originally  developed  in 
other  contexts.  We  approach  the  partial  realization  problem  from 
several  different  angles  and  explore  the  connections  to  such  to¬ 
pics  as  factorization  of  Hankel  matrices,  block  tridiagonalization, 
generalizations  of  the  Lanczos  process  for  biorthogonalization, 
the  Euclidean  algorithm  and  the  principal  part  continued  .fractions 
of  Arne  Magnus,  the  Pad€  table,  and  the  Berlekamp-Massey  algorithm. 
In  this  way  we  are  able  to  clarify  some  previous  results  by  Rissa- 
nen,  Kalman  and  others  and  place  them  in  a  broader  context.  This 
leads  to  several  results  and  concepts  which  we  think  are  new.  Our 
analysis  is  restricted  to  the  scalar  case,  but  some  definitions 
and  formulations  have  been  rigged  to  facilitate  an  extension  to 
the  matrix  case. 

20.  Stability  and  Instability  of  partial  realizations 

A  finite  or  infinite  sequence  of  real  numbers  is  said  to  be 
stable  if  it  admits  minimal  realization  by  a  stable  linear  system. 
It  is  shown  that  the  preservation  of  stability  as  such  a  sequence 
is  truncated  or  extended  is  not  a  generic  property  even  among 
stable  sequences.  This  is  of  interest  for  identification  of  linear 
systems  from  partial  data  and  for  partial  realization  of  random 
systems,  in  which  cases  it  constitutes  a  negative  result.  Certain 
finite  sequences  have  infinitely  many  minimal  realizations  each 
having  different  stability  properties.  In  this  case,  a  graphical 
criterion  in  the  spirit  of  the  Nyquist  criterion  is  derived  to 
exploit  this  lack  of  uniqueness  in  order  to  determine  whether 
one  can  achieve  a  stable  pole  placement  by  a  judicious  choice  of 
partial  realization. 

22.  On  the  structure  of  state  space  models  for  discrete-tine 

stochastic  vector  processes 

From  a  conceptual  point  of  view,  structural  properties  of 


-20- 


linear  stochastic  systems  are  best  understood  in  a  geometric  for¬ 
mulation  which  factors  out  the  effects  of  the  choice  of  coordi¬ 
nates.  In  this  paper  we  study  the  structure  of  discrete-time  linear 
systems  with  stationary  inputs  in  the  geometric  framework  of 
splitting  subspaces  set  up  in  the  work  by  Lindquist  and  Picci.  In 
addition  to  modifying  some  of  the  realization  results  of  this  work 
to  the  discrete-time  setting,  we  consider  some  problems  which  are 
unique  to  the  discrete- time  setting.  These  include  the  relations 
between  models  with  and  without  noise  in  the  observation  channel, 
and  certain  degeneracies  which  do  not  occur  in  the  continuous¬ 
time  case.  One  type  of  degeneracy  is  related  to  the  singularity 
of  the  transfer  function,  another  to  the  rank  of  the  observation 
noise  and  invariant  directions  of  the  matrix  Riccati  equation  of 
Kalman  filtering.  He  determine  to  what  extent  these  degeneracies 
are  properties  of  the  output  process.  The  geometric  framework 
also  accomodates  infinite-dimensional  state  spaces,  and  therefore 
the  analysis  is  not  limited  to  finite-dimensional  systems. 

23.  Extreme  points  of  Riccati  inequalities 

The  purpose  of  this  note  is  to  clarify  some  of  the  relations 
that  exist  between  solutions  of  the  algebraic  Riccati  equation  and 
the  quadratic  matrix  inequalities.  In  particular  the  main  result 
of  the  note  is  to  establish  that  there  are  extreme  points  in  the 
solution  set  of  quadratic  matrix  inequalities  that  are  not  solu¬ 
tions  of  the  algebraic  Riccati  equations.  The  history  of  this  is 
typical  of  many  results  involving  Riccati  equations  in  the  engi¬ 
neering  literature-total  confusion.  It  has  been  part  of  the  folklore 
for  many  years  that  the  solutions  of  the  algebraic  Riccati  equation 
are  extreme  points  of  the  quadratic  matrix  inequalitis.  In  Badawi's 
thesis  (Ref.  11)  a  very  elegant  proof  is  given:  however,  in  re¬ 
view  it  was  discovered  that  there  had  in  fact  appeared  a  proof 
in  the  literature.  In  the  book  FCG  there  is  indeed  a  proof  and 
a  footnote  to  the  effect  that  there  are  extreme  points  other  than 
the  solutions  of  the  algebraic  Riccati  equation. 

Thus  it  seems  to  be  known  that  there  are  extreme  points  that 
are  not  solutions  of  the  algebraic  Riccati  equation.  However,  we 
have  been  unable  to  find  a  proof  in  the  literature  or  in  the  folk- 


lore.  In  this  note  we  present  a  class  of  examples  that  establishes 
that  there  are  other  extreme  points. 

FCG  Faurre,  P.f  Clerget,  M.  and  Germain,  F. ,  "OpSraturs  Rationel 
Postifs",  Dunod,  1979. 

24.  Infinite  dimensional  stochastic  realizations  of  continuous¬ 
time  stationary  vector  processes 

In  this  paper  we  consider  the  problem  of  representing  a  given 
stationary  Gaussian  process  with  nonrational  spectral  density  and 
continuous  time  as  the  output  of  a  stochastic  dynamical  system. 
Since  the  spectral  density  is  not  rational,  the  dynamical  system 
must  be  infinite-dimensional,  and  therefore  the  continuous-time 
assumption  leads  to  certain  mathematical  difficulties  which  require 
the  use  of  Hilbert  spaces  of  distributions.  (This  is  not  the  case 
in  discrete  time.)  We  show  that,  under  certain  conditions,  there 
corresponds  to  each  proper  Markovian  splitting  subspace,  two  stan¬ 
dard  realizations,  one  evolving  forward  and  one  evolving  backward 
in  time. 

25.  Forward  and  backward  semimart ingale  representations  of  statio¬ 
nary  Increment  processes 

Let  {y(t)}  be  a  p.n.d.  Gaussian  stationary  increments  process 
and  {St>,  {St>  two  families  of  subspaces  (or  o-algebras)  such  that 
(i)  Sfc  is  increasing  and  Sfc  is  decreasing  with  time  (ii)  the 
future  (past)  increments  of  y  at  the  instant  t  are  Sfc  (resp.  Sfc) 
measurable  (iii)  the  pair  (S^,St)  is  perpendicularly  intersecting 
for  each  t.  The  process  y  has  a  forward  semimartingale  representa¬ 
tion  with  rcspeot  to  {Sfc}  if 

dy(t)  ■  z(t)dt  ♦  du(t)  (*) 

where  z(t)  is  an  St-measurable  (stationary)  process  and  u(t)  is  an 
St-martingale.  In  this  representation,  (x(t)}  is  often  called  the 
forward  conditional  derivative  of  y  w.r.  to  (St>. 

We  study  conditions  under  which  the  existence  of  a  forward 
representation  of  the  type  (*)  implies  that  y  also  admits  a  semi¬ 
martingale  representation  w.r.  to  the  companion  "backward”  family 
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i.e.  one  of  the  form 

dy(t)  »  z(t)dt  +  du(t) 

where  z(t)  is  St-measurable  and  u(t)  is  a  (backward)  St-martin- 
gale.  As  it  turns  out,  the  theory  of  Stochastic  Realization  to¬ 
gether  with  the  concepts  of  (stochastic)  observability  and  con¬ 
structability  provides  natural  tools  for  attacking  the  problem. 
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E.  INTERACTIONS 

Results  obtained  within  the  project  have  been  presented  on 
the  following  occations. 


Professional  Meetings 

1.  Workshop  on  Current  Topics  in  Communications,  Washington 
University,  St.  Louis,  March  6-7,  1978  (A.  Lindquist,  invited 
speaker) . 

2.  Workshop  on  Fast  and  Square-Root  Algorithms,  University  Catho- 
lique  de  Louvain,  Belgium,  June  1978  (A.  Lindquist,  invited 
speaker) . 

3.  21st  Midwest  Symposium  on  Circuits  and  Systems,  Ames,  Iowa, 

August  14-15,  1978  (A.  Lindquist,  invited  speaker). 

4.  17th  Conference  on  Decision  and  Control,  San  Diego,  January 
10-12,  1979  (A.  Lindquist;  SIAM-paper,  invited). 

5.  Special  Session  on  Integral  Equations  with  Emphasis  on  Fredholm 
and  Hammerstein  Equations,  85th  annual  meeting  of  the  AMS, 

Biloxi,  January  24-28,  1979  (A.  Lindquist,  invited  speaker; 
could  not  attend  due  to  illness) . 

6.  IEEE  International  Symposium  of  Information  Theory,  Grigano, 
Italy,  June  25-29,  1979  (A.  Lindquist  or  G.  Picci) . 

7.  4th  International  Symposium  on  Mathematical  Theory  of  Networks 
and  Systems,  Delft,  Holland,  July  3-6,  1979  (A.  Lindquist  and 
G.  Picci,  invited  speakers). 

8.  Special  Session  of  Stochastic  Realization  Theory  (organized 

by  A.  Lindquist),  1979  International  Conference  on  Information 
Sciences  and  Systems,  Patras,  Greece,  July  9-13,  1979  (G.  Picci). 

9.  1-979  Conference  on  Decision  and  Control,  Fort  Lauerdale, 

Florida,  Dec  12-14,  1979  (F.  Badawi) . 

10.  Miniconference  in  Mathematical  System  Theory,  Ohio  State  Uni-  , 
versity,  February  23,  1980  (A.  Lindquist,  invited  speaker). 

1 1 .  Numerical  Techniques  in  System  Engineering  Workshop,  University 
of  Kentucky,  June  16-20,  1980  (G.  Picci,  invited  speaker). 

12.  NATO  Advanced  Studies  Institute  Meeting  on  Stochastic  Systems, 
Lea  Arcs,  France,  June  22-July  5,  1980  (G.  Picci,  invited 

speaker) . 
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13.  Short  Course  on  Diffusion  Processes,  Clemson  University, 

(A.  Lindquist,  invited  speaker  but  unable  to  attend) . 

14.  Workshop  on  Feedback  and  Synthesis  of  Linear  and  Nonlinear 
Systems,  Rome,  Italy,  June  29-July  3,  1981  (A.  Lindquist, 
invited  speaker) . 

15.  1981  International  Symposium  on  the  Mathematical  Theory  of 
Networks  and  Systems  (MTNS) ,  Santa  Monica,  California, 

August  5-7,  (A.  Lindquist,  invited  speaker) . 

16.  European  Conference  on  Circuit  Theory  and  Design,  The  Hague, 

The  Netherlands,  August  25-28,  1981  (A.  Lindquist,  invited 
speaker,  unable  to  attend) .  . 

17.  Workshop  on  Rational  Approximation  for  Systems,  Leuven, 

Belgium,  August  31-September  1,  1981  (A.  Lindquist,  invited 
speaker,  unable  to  attend) . 

18.  The  1981  IEEE  Decision  and  Control  Conference,  San  Diego, 

Dec.  1981  (was  unable  to  attend,  but  Ref.  21  in  proceedings). 

19.  NATO  Advanced  Studies  Institute  of  Workshop  on  Nonlinear 
Stochastic  Problems,  Algarve,  Portugal,  May  16-28,  1982 
(A.  Lindquist,  invited  speaker). 

20.  The  Second  Bad  Honnef  Conference  of  Stochastic  Differential 
Systems,  Bonn,  West  Germany,  June  27-July  3,  1982  (A.  Lindquist 
invited  speaker) . 

21.  1983  International  Symposium  on  the  Mathematical  Theory  of 
Networks  and  Systems,  Beer  Sheva,  Israel,  June  20-24,  1983 
(A.  Lindquist,  invited  to  organize  a  special  session  on  sto¬ 
chastic  realization  theory:  talk  by  G.  Picci) . 

22.  Workshop  on  Linear  Operator  Theory,  Weizmann  Institute, 

Rehovot,  Israel,  June  13-18,  1983;  organized  by  Harry  Dym 
and  Israel  Gohberg  (A.  Lindquist,  invited  speaker). 


Colloqula  and  Seminars 

1.  Washington  University,  November  1978  (G.  Picci) 

2.  M.I.T.,  November  1978  (G.  Picci) 

3.  M.I.T.,  November  1978  (M.  Pavon) 

4.  Toronto,  April  9,  1979  (A.  Lindquist) 
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5.  Brown  University,  April  10-11,  1979  (A.  Lindquist) 

6.  M.I.T.,  April  12,  1979  (A.  Lindquist) 

7.  University  of  Maryland,  February  23,  1980  (A.  Lindquist) 

8.  Johns  Hopkins  University,  Baltimore,  Febrauary  29,  1980 
(A.  Lindquist) 

9.  Series  of  Lectures  and  Colloquium  at  University  of  Maryland, 
College  Park,  November  10-14,  1980  (A.  Lindquist) 

10.  Series  of  Lectures  and  Colloquium  at  M.I.T.,  November  19-22, 
1980  (A.  Lindquist) 

11.  Colloquium  at  McGill  University,  Montreal,  Canada,  November  24, 

1980  (A.  Lindquist)  t 

12.  Colloquium  at  Washington  University,  St.  Louis,  December  2, 

1980  (A.  Lindquist) 

13.  Seminar  at  U.C.L.A. ,  December  4,  1980  (A.  Lindquist) 

14.  Colloquium  at  University  of  California,  San  Diego, 

December  5,  1980  (A.  Lindquist) 

15.  Seminar  at  University  of  California,  Santa  Barbara, 

December  8,  1980  (A,  Lindquist) 

16.  Colloquium  at  University  of  Florence,  Italy,  June  1981 
(A.  Lindquist) 

17.  Colloquium  at  Schlumberger-Doll  Research  Center,  Ridgefield, 
Connecticut,  Nov.  18,  1982  (A.  Lindquist) 

18.  Colloquium  at  University  of  Maryland,  April  5,  1983  (A.  Lind¬ 
quist)  . 


